To improve the prediction ability of image memorability, a method for automatically predicting the memorability of an image was proposed by using visual saliency entropy and improved Object Bank feature. The proposed method improved the traditional Object Bank feature and extracted the visual saliency entropy feature. Then a prediction model of image memorability was constructed by using Support Vector Regression (SVR). The experimental results show that the correlation coefficiency of the proposed method is three percentage higher than the state-of-the-art method. The proposed model can be used in image memorability prediction, image retrieval ranking and advertisement assessment analysis.